An improved Monte Carlo Tree Search approach to workflow scheduling

نویسندگان

چکیده

Workflow computing has become an essential part of many scientific and engineering fields, while workflow scheduling long been a well-known NP-complete research problem. Major previous works can be classified into two categories: heuristic-based guided random-search-based methods. Monte Carlo Tree Search (MCTS) is recently proposed search methodology with great success in AI on game playing, such as Computer Go. However, researchers found that MCTS also potential application other domains, including combinatorial optimization, task scheduling, planning, so on. In this paper, we present new approach based MCTS, which still rarely explored direction. Several mechanisms are developed for the major steps to improve execution schedules further. Experimental results show our outperforms methods significantly terms makespan.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Monte-Carlo Tree Search

representation of the game. It was programmed in LISP. Further use of abstraction was also studied by Friedenbach (1980). The combination of search, heuristics, and expert systems led to the best programs in the eighties. At the end of the eighties a new type of Go programs emerged. These programs made an intensive use of pattern recognition. This approach was discussed in detail by Boon (1990)...

متن کامل

Improved Monte-Carlo Search

Monte-Carlo search has been successful in many non-deterministic games, and recently in deterministic games with high branching factor. One of the drawbacks of the current approaches is that even if the iterative process would last for a very long time, the selected move does not necessarily converge to a game-theoretic optimal one. In this paper we introduce a new algorithm, UCT, which extends...

متن کامل

An Analysis of Monte Carlo Tree Search

Monte Carlo Tree Search (MCTS) is a family of directed search algorithms that has gained widespread attention in recent years. Despite the vast amount of research into MCTS, the effect of modifications on the algorithm, as well as the manner in which it performs in various domains, is still not yet fully known. In particular, the effect of using knowledgeheavy rollouts in MCTS still remains poo...

متن کامل

A Monte Carlo Tree Search approach to Active Malware Analysis

Active Malware Analysis (AMA) focuses on acquiring knowledge about dangerous software by executing actions that trigger a response in the malware. A key problem for AMA is to design strategies that select most informative actions for the analysis. To devise such actions, we model AMA as a stochastic game between an analyzer agent and a malware sample, and we propose a reinforcement learning alg...

متن کامل

Adapting Improved Upper Confidence Bounds for Monte-Carlo Tree Search

The UCT algorithm, which combines the UCB algorithm and Monte-Carlo Tree Search (MCTS), is currently the most widely used variant of MCTS. Recently, a number of investigations into applying other bandit algorithms to MCTS have produced interesting results. In this research, we will investigate the possibility of combining the improved UCB algorithm, proposed by Auer et al. [2], with MCTS. Howev...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Connection science

سال: 2022

ISSN: ['0954-0091', '1360-0494']

DOI: https://doi.org/10.1080/09540091.2022.2052265